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(£) Video signal transmission system and method. 

(57) In a video signal transmission system in 
which input video signals are coded for trans- 
mission, the coded data are decoded with quan- 
tization information (S9) determined for each 
block group (GOB) from the amount of the data 
remaining in the buffer memory (10). The de- 
coded data (S22) are compared with the original 
video data (S1) to determine the difference 
(S23). The differences are weighted with flat- 
ness which relates to the degree of perceivabt- 
lity of possible distortion. The quantization size 
for the video data to be transmitted (S8) is 
determined based on the difference or the 
weighted difference so that the quality of the 
picture to be transmitted can be improved. 



CM 

CO 
CM 




IT) 



o 

H 



CL 
LU 



Jouve, 18, rue Saint-Denis, 75001 PARIS 



MSDOCID: <EP 0526201 A2 I > 



1 



EP 0 526 201 A2 



2 



This invention relates to a video signal transmis- 
sion system for transmitting a video signals of com- 
pressed data, and is more particularly suitable for ap- 
plication to a video signal transmission system which 
transmits picture data compressed by a method of or- 5 
thogonal transformation, e.gdiscrete cosine transfor- 
mation and the like. 

In conventional video signal transmission sys- 
tems, for example, picturephones or tele-conference 
systems, which transmit video signals of moving pic- 10 
tures to a distant place, video signals are coded by us- 
ing correlation between the frames of video signals so 
that more effective transmission of significant infor- 
mation and effective utilization of transmission line 
can be achieved. is 

Lef s take the picture shown in Fig. 1 as an exam- 
ple, where pictures PC1, PC2, PC3 which consti- 
tute a moving picture, are to be transmitted at the time 
t=t 1f t 2 , t 3 , .... In the intra-frame coding system, these 
pictures are coded one-dimensionally on the same 20 
line and then transmitted. 

On the other hand, the inter-frame coding is car- 
ried out to improve compression efficiency by obtain- 
ing the video data PC12, PC23, ... which are the dif- 
ferences between the neighboring pictures, i.e, be- 25 
tween PC1 and PC2, between PC2 and PC3, and so 
on, based on the autocorrelation of the video signal 
on the time axis. 

Thus, the video signal transmission system can 
transmit the pictures PC1, PC2, PC3, ... on a trans- 30 
mission line with the high efficiency coded digital data 
whose size is extremely small compared to the case 
that all data of pictures are transmitted. 

That is, as shown in Fig. 2, in a video-signal- 
transmission-system 1, a preprocessing circuit 2 35 
processes an input video signal VD by frequency- 
band limiting, output sequence exchanging and so on 
to give the input video data S1 . 

In the above operation, the video data which are 
sent out sequentially as input video data S1 are ex- 40 
tracted from the frame video data FRM by the method 
shown in Fig. 3. 

Video data of one frame FRM are divided into 2 
(horizontal) x 6 (vertical) block groups GOB. Each 
block group GOB includes 1 1 (horizontal) x 3 (vertical) 45 
macro-blocks MB, and each macro-block MB has 
brightness signals Y<t through Y 4 for 8 x 8 picture ele- 
ments and color difference signal data C b and C r 
which are composed of color difference signals cor- 
responding to all these picture elements. 50 

In a block group GOB, macro-blocks MB are ar- 
rayed in the order of consecutive video data, and mac- 
ro-blocks are arrayed in a macro- block in the order of 
raster scanning. 

Here, as for brightness signals, each macro-block 55 
MB has video data of 16 x 16 picture elements (Y 1 
through Y 4 ) as a unit which are put in the consecutive 
order in both the horizontal and vertical directions. On 



the other hand, as for two color differential data cor- 
responding to these picture elements, the amount of 
the data is compressed and furthermore these data 
are multiplexed on the time axis, and then the data for 
16x16 picture elements are allocated to each micro- 
block C r and C b . 

When both of the input video data S1 and the pre- 
vious-frame data S2 previously stored in the previous- 
frame memory 4 are given to the difference-data gen- 
eration circuit 3, it determines the difference between 
the input video data S1 and the previous-frame data 
S2 and generates inter-frame coded data S3 (here- 
after, this is called inter-frame coded mode). The dif- 
ference data S3 are applied to the discrete cosine 
transformation (DCT) circuit 6 through the switching 
circuit 5, and to the switching control circuit 7. 

The switching circuit 5 is controlled by the control 
signal S4 which is applied from the switching control 
circuit 7 so that the input video signal S1 Is selected 
for an output signal in case that it is decided to be pos- 
sible that intra-field coding would give the less 
amount of transmission data and so that the differ- 
ence data S3 is selected for an output signal in case 
that it is decided to be possible that interframe coding 
would give the less amount of transmission data. 

The discrete cosine transformation circuit 6 per- 
forms discrete cosine transformation for the input vid- 
eo data S1 or the difference data S3 of each micro- 
block basedjon the two-dimensional correlation of the 
video signal. Then the transformation data S5 ob- 
tained as a result of this transformation is applied to 
quantization circuit 8. 

The quantization circuit 8 quantizes the transfor- 
mation data S5 with a quantization step size which is 
determined for each block group GOB. And quantiza- 
tion data S6 which appear at the output terminal as a 
result of this quantization, are applied to the variable 
length code (VLC) circuit 9 and the Inverse quantiza- 
tion circuit 12. 

Then the variable length code circuit 9 performs 
variable length coding for the quantization data S6 to 
convert them to the transmission data S7, which are 
supplied to the transmission buffer memory (BM) 10. 

The transmission buffer memory 10 stores tem- 
porarily the transmission data S7 in a memory and 
then outputs these stored data to the transmission line 
11 as the output data S8 with the adequate timing, 
while it also feeds the quantization control signal S9 
back to the quantization circuit 8 depending on the 
amount of the residual data remaining in the memory 
in order to control the quantization step size. 

Thus, the transmission buffer memory 10 adjusts 
the amount of data which are generated as the quan- 
tization data S6 so that it maintains the proper amount 
of, residual data in the memory (in order to avoid either 
overflow or underflow). 

When, incidentally, the amount of the residual 
data remaining in the transmission buffer memory 10 
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increases and reaches the maximum allowed 
amount, the transmission buffer memory 10 sends 
the quantization control signal S9 to increase the 
quantization step size STPS (see Fig. 4) so that the 
amount of quantization data SB decreases. 5 

When, conversely, the amount of the residual 
data remaining in transmission buffer memory 10 de- 
creases and reaches the minimum allowed amount, 
transmission buffer memory 10 sends the quantiza- 
tion control signal S9 to decrease the quantization 10 
step size STPS so that amount of quantization data 
S6 increases. 

The inverse quantization circuit 12 performs in- 
verse-quantization for the quantization data S6 re- 
ceived from the quantization circuit 8 to convert them 15 
into representative values, i.e., the inverse quantiza- 
tion data S10. Thus the output data S8 are decoded 
into the transformation data corresponding to such 
data for which quantization with quantization circuit 8 
was not yet carried out Then the inverse quantization 20 
data S10 are applied to the inverse discrete cosine 
transformation circuit 13. 

The inverse discrete cosine transformation circuit 
13 transforms the inverse quantization data S10, 
which are decoded with inverse quantization circuit 25 
12, into the decoded video data S11 by the transfor- 
mation process which is the inverse of transformation 
of the discrete cosine transformation circuit 6. And the 
decoded video data S11 are applied to the previous- 
frame data generation circuit 14 and the switching cir- 30 
cuit 15. 

Thus, the inverse discrete cosine transformation 
circuit 13 provides the decoded data to the transmit- 
ter, which are identical to the decoded data which will 
be obtained in receivers, by decoding the output data 35 
S8 to get the data corresponding to the input video 
data S1 or the differential data S3 which were not yet 
transformed with the discrete cosine transformation 
circuit 6. 

That is, the inverse discrete cosine transforma- 40 
tion circuit 13 reproduces the data identical to the in- 
put video data S1 in case that the video signal VD is 
transmitted with intra-fie Id coding, but in case that the 
video signal VD is transmitted with inter-frame coding, 
it reproduces the data identical to the difference data 45 
S3. 

The previous-frame data generation circuit 14 re- 
produces the previous-frame video data correspond- 
ing to the data which was sent out as the output data 
S8, by adding the decoded video signal S11 and the so 
previous-frame data S2 which is fed back from the 
previous-frame memory 4. Then the reproduced vid- 
eo data is sent to the previous-frame memory 4 
through the switching circuit 15 and thus the pictures 
sent to receivers are reproduced sequentially and 55 
stored in the previous-frame memory 4. 

Switching operation of the switching circuit 1 5 is 
controlled by the control signal S4 which is delayed at 



the delay circuit 16 for the time required for the video 
signal VD to be completed discrete cosine transfor- 
mation through inverse discrete cosine transforma- 
tion. 

However, the conventional video transmission 
systems 1 has the following problems. 

The amount of data generated from the quantiza- 
tion circuit 8 for each block group GOB are. leveled 
based on the amount of the residual data remaining 
in the transmission buffer memory 1 0, therefore when 
there exist both types of pattern, the pattern which 
can be easily distorted and the pattern which is not 
distorted easily, in the same block group GOB, con- 
spicuous degradation of picture quality occurs in the 
pattern which can be easily distorted. Therefore, con- 
stant picture quality cannot be obtained. 

In the case that the amount of transmission infor- 
mation fluctuates drastically at local areas of a pic- 
ture, for example such as a picture of a rotating- water 
wheel, a certain block of plural blocks MB constituting 
block group GOB contains the picture information of 
both of fine and flat structures, therefore if quantiza- 
tion step size is set to an averaged value, distortion 
concentrates locally at the block including the vanes 
of the water wheel and the patterns of the vanes might 
become dim, or it might be seen distortion with every 
blocks on the peripheral flat portion. 

The discrete cosine transformation system also 
has a feature that distortion spreads over the whole 
blocks, therefore distortion depends strongly on the 
pattern of the picture to be transmitted, and distortion 
fluctuates. In the high quality picture transmission 
system, it is important to obtain stable and uniform 
picture quality independent of the content of the pic- 
ture to be transmitted, therefore the distortion is a 
great problem. 

There are cases where the distortion of the pic- 
ture is easily perceivable or hmperceivable from the 
sight of brightness level, due to the linearity in the 
sight characteristic, for example even if distortion 
quantity is identical. 

The distortion generated based on the sight char- 
acteristic is very important in the high quality picture 
transmission system in which it is desired that the pic- 
ture quality is uniform independent to the content of 
the picture to be transmitted. 

The distortion of the picture is not only imperceiv- 
able at edge portions of the picture but also easily per- 
ceive at flat portions of the picture. 

For thiSi there was problem that the distortion of 
the flat portions is more perceivable than the distor- 
tion of the edge portions in the picture having the flat 
portions and the end portions admixed, when quantity 
of information data to be generated is controlled so 
that distribution of the picture distortion generated on 
the picture to be transmitted is simply uniform. 

In view of the foregoing, an object of this invention 
is to provide a video signal transmission system which 
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can transmit picture signals having uniformity in pic- 
ture quality over whole picture, even if radically varied 
input pictures which are admixed of pictures capable 
of producing distortion and pictures not capable of 
producing distortion. 5 

Another object of the invention is to provide a vid- 
eo signal transmission system in which distortion of 
flat portion easily perceivedis not concentrated to 
yield an improvement of the transmission picture in 
quality. 10 

According to one aspect of this invention, a video 
signal transmission system for orthogonal transform- 
ing a video signal which is constituted by unit block 
groups with plural unit blocks into coefficient data and 
then quantizing said coefficient data into quantization 1 5 
data, comprising: a block decoding means for quan- 
tizing and inverse-quantizing said coefficient data 
based on first quantization information determined by 
each of said unit block groups, and performing in- 
verse-orthogonal transforming; a difference data de- 20 
tecting means for getting the difference data between 
said local decoding data decoded by said local decod- 
ing means and the original video signal correspond- 
ing to said local decoding data; a controlling means for 
determining second quantization information for each 25 
of said unit blocks based on the detection result of 
said difference data detecting means; and a quantiz- 
ing means for determining a quantizing size of said 
video signal based on said first quantization informa- 
tion and said second quantization information. 30 

According to other aspect of this invention, a vid- 
eo signal transmission method for orthogonal trans- 
forming a video signal which is constituted by unit 
block groups with plural unit blocks into coefficient 
data and then quantizing said coefficient data into 35 
quantization data, comprising steps of: quantizing 
and inverse-quantizing said coefficient data based on 
first quantization information determined by each of 
said unit block groups, and performing inverse-ortho- 
gonal transforming; getting the difference data be- 40 
tween said local decoding data and the original video 
signal corresponding to said local decoding data; de- 
termining second quantization information for each of 
unit blocks based on said difference data; and deter- 
mining a quantizing size of said video signal based on 45 
said first quantization information and said second 
quantization Information. 

According to other aspect of this invention, a vid- 
eo signal transmission method for orthogonal trans- 
forming a video signal which is constituted by unit so 
block groups with plural unit blocks into coefficient 
data and then quantizing said coefficient data into 
quantization data, comprising steps of: quantizing 
and inverse-quantizing said coefficient data based on 
first quantization information determined by each of 55 
said unit block groups, and performing inverse-ortho- 
gonal transforming; getting the difference data be- 
tween said local decoding data and the original video 



signal corresponding to said local decoding data; de- 
tecting flatness for each picture element constituting 
said unit blocks; determining second quantization in- 
formation for each of said unit blocks corresponding 
to distortion evaluation value to be determined based 
on said flatness and said difference data; and quan- 
tizing said video signal based on said first quantiza- 
tion information and said second quantization infor- 
mation. 

The nature, principle and utility of the invention 
will become more apparent from the following detailed 
description when read in conjunction with the accom- 
panying drawings in which like parts are designated 
by like reference numerals or characters. 

Embodiments of the invention will now be descri- 
bed, by way of example only, with reference to the ac- 
companying drawings in which: 

Fig. 1 is a schematic representation for explaining 

intra-frame and inter-frame coding; 

Fig. 2 is a block diagram of a conventional video 

data transmission system; 

Fig. 3 is a schematic representation showing con- 
stitution of video data of a frame; 
Fig. 4 is a schematic representation for explana- 
tion of quantization steps; 
Fig. 5 is a block diagram of one video data trans- 
mission system embodying the present invention; 
Fig. 6 is a block diagram showing the quantization 
parameter control circuit of Fig. 5. 
Fig. 7 is a block diagram of a video data transmis- 
sion system for another embodiment; 
Fig. 8 is a block diagram of a quantization para- 
meter control circuit of Fig. 7; 
Fig. 9 is a block diagram of a video data transmis- 
sion system for another embodiment; 
Fig. 10 is a schematic representation for explain- 
ing the expectation of flatness with flatness ex- 
pectation circuit of Fig. 9; and 
Fig. 1 1 is a block diagram for explanation of quan- 
tization parameter control circuit of Fig. 9. 
Fig. 5 shows the video data transmission system 
20 which has the same constitution as that shown in 
Fig. 2 and like parts are designated by like reference 
numerals in Fig. 2: except for 

the first local decoding circuit block group 21 A 
comprising the inverse quantization circuit 12, the in- 
verse discrete cosine transformation circuit 13, and 
the previous-frame data generation circuit 14; 

the second local decoding: circuit block group 
21 B; and 

the quantization parameter control circuit 22 
which controls quantization parameters of each block 
of the pictures to be transmitted based on the decod- 
ing results given by the first and second local decod- 
ing circuit block group 21 A and 21 B. 

The second local decoding circuit block group 
21 B detects the distortion of the transformation data 
S5 compared with the original video data before the 
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transformation data S5 are actually quantized with the 
quantization circuit 8, by decoding the transformation 
data S5 which is the output from the discrete cosine 
transformation circuit 6. 

In the above operation of the second local decod- 5 
ing circuit system 21 B, the transformation data S5 
from the discrete cosine transformation circuit 6 are 
applied to quantization/inverse-quantization circuit 
(QCT) 23 which comprises read only memory. 

With discrete cosine transformation circuit 6, 10 
coefficients of the data which are transformed by dis- 
crete cosine transformation are quantized (i.e., clas- 
sified) based on the quantization performance deter- 
mined by the quantization control signal S9 for each 
block group GOB which is fed back from the transmis- 1 5 
sion buffer memory 10, and then converted by in- 
verse quantization (i.e., converted into representative 
values) and applied to the inverse discrete cosine 
transformation circuit 24. 

The inverse discrete cosine transformation circuit 20 
24 transforms the representative values by inverse 
discrete cosine transformation to get the inverse 
transformation data S21, which are applied to the ad- 
dition circuit 25 and the switching circuit 26. 

Then, the addition circuit 25 adds the inverse 25 
transformation data S21 to the local decoding data S2 
of the previous frame stored in the previous-frame 
memory 4 so that the video data which would be 
transmitted with quantization step size which would 
be determined by the quantization control signal S9, 30 
is decoded and applied to the switching circuit 26. 

The switching circuit 26 is controlled by the con- 
trol signal S4 with the delay at delay circuit 27 for the 
time needed for the second local decoding circuit 
block group 21 B to perform the signal processing for 35 
the video data from the discrete cosine transformation 
circuit 6 through the inverse discrete cosine transfor- 
mation 24, so that the proper local decoding data S22 
is selected to apply to the distortion calculation circuit 
28 depending on whether the present video data to be 40 
transmitted on transmission line 11 are encoded by in- 
ter-filed coding or by inter-frame coding. 

The distortion calculation circuit 28 calculates the 
magnitude of distortion for the same sample by calcu- 
lating the difference between the original input video 45 
data S1 received from the delay circuit 29 and the lo- 
cal decoding data S22 received from the switching cir- 
cuit 26, then the calculated magnitude, distortion data 
S23, is sent to the quantization parameter control cir- 
cuit 22. 50 

The delay circuit 29 is constituted by FIFO (first 
in first out) memory and it makes the original input vid- 
eo data S1 delayed for the time needed for the input 
video signal S1 to be processed with from the discrete 
cosine transformation circuit 6 through the local de- 55 
coding circuit 21 B. 

The quantization parameter control circuit 22 
sends the quantization control signal S24 to the quan- 



tization circuit 8 to control the quantization step size 
for each block of the video data to be transmitted 
based on the distortion data S23 received from the 
distortion calculation circuit 28 and on the quantiza- 
tion control signal S9 for each block group GOB re- 
ceived from the transmission buffer memory 10. 

Thus, the quantization parameter control circuit 
22 can locally control the local quantization step size 
for each block before the video data are actually trans- 
mitted, to the extent that it does not affect smoothing 
of the amount of generated information of the video 
data. 

Hence, even for blocksin the same block group 
GOB, the quantization step size can be reduced for a 
block which has a large distortion and, in contrast, the 
quantization step size can be increased for a : block 
which has a small distortion, so that high picture qual- 
ity of the video signal to be transmitted is maintained. 

That is, in the quantization parameter control cir- 
cuit 22, as shown in Fig. 6, the distortion data S23 re- 
ceived from the distortion calculation circuit 28 is ap- 
plied to the absolute value circuit 30 to determined the 
absolute value of distortion with respect to the original 
video data S1, and then this value is sent out as the 
absolute difference data S31. 

The integration circuit 31 calculates the sum of 
the absolute difference data S31 received from the 
absolute circuit 30 for each block then supplies the 
calculated value to the subtraction circuit 32 as the in- 
tegral distortion data S32. 

The subtraction circuit 32 calculates the differ- 
ence between the integral distortion data S32 and the 
standard distortion data S33 received from the stan- 
dard distortion generation circuit 33 comprising read 
only memory and the like. And the calculated differ- 
ence data S34 are sent to the quantization parameter 
determination circuit 34. 

In the above operation, the standard distortion 
generation circuit 33 predicts previously the typical or 
average value of the sum of the absolute values of dis- 
tortion which would occur in each block, based on the 
control parameters for each block group GOB which 
are received as the quantization control signals S9 
from the transmission buffer memory 1 0. This predict- 
ed value is output as the standard distortion data S33. 

The quantization parameter determination circuit 
34 sends the control parameter, control data S34, 
which determines the quantization step size for each 
block to minimize the difference data S34, which is 
the difference between the integral distortion data 
S32 and the standard distortion data S33, to the quan- 
tization circuit 8 and the inverse quantization circuit 12 
so that picture quality is maintained almost constant 
while the video data, which corresponds to the block 
group GOB processed with the second local decoding 
circuit block group 21, is being transmitted on trans- 
mission line 11. 

The first local decoding circuit block group 21A 
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performs inverse quantization for the quantization 
data S6 based on the quantization control data S9, 
which is quantization parameters determined for each 
block group GOB, and based on the quantization con- 
trol data S24, which is quantization parameters deter- s 
mined for each block. 

Incidentally, in the video data transmission sys- 
tem 20, the transformation data S5 from the discrete 
cosine transformation circuit 6 is applied to the quan- 
tization circuit 8 with the adequate delay given by de- 10 
lay circuit 36 comprising FIFO memory. 

In the above operation, the delay circuit 36 makes 
the transformation data S5 delayed for the time need- 
ed for signal processing of the video data with the sec- 
ond local decoding circuit block group 21 B and the 15 
quantization parameter control circuit 22, that is, the 
time needed signal processing with the quantiza- 
tion/inverse-quantization circuit 23 through to the 
quantization parameter determination circuit 34. Then 
the delayed data is applied to the quantization circuit 20 
8. Thus, the video data transmission system 20 can 
achieve feedforward operation based on the content 
of the picture to be transmitted. 

Furthermore, in the video data transmission cir- 
cuit 20, the previous-frame data S2 supplied from the 25 
previous-frame memory 4 are applied to the previous- 
frame data generation circuit 14 in the first local de- 
coding circuit block group 21 A, with the delay at the 
delay circuit 37 comprising FIFO memory. 

In the above operation, the delay circuit 37 makes 30 
the previous-frame data delayed for the time needed 
for signal processing by the second local decoding cir- 
cuit block group 21B and the quantization parameter 
control circuit 22. As a result of this, the previous-fra- 
me data which was already transmitted on transmis- 35 
sion line 11 can be decoded. 

Let's take, as an example, a picture of a water 
wheel with the sky in the background. When the video 
signal VD of the block group GOB which corresponds 
to the boundary between the background which is not 40 
degraded easily and the vanes of the wheel which 
might be easily degraded, is applied to preprocessing 
circuit 2, then preprocessing circuits converts the vid- 
eo signal VD to the 8-bit input video data S1 and sup- 
plies this converted data to the difference-data gen- 45 
eration circuit 3 and the delay circuit 29. 

The difference-data generation circuit 3 determi- 
nes the inter-frame difference data S3, i.e., the differ- 
ence between the present input video data S1 applied 
from preprocessing circuit 2 and the previous-frame 50 
data of corresponding block group supplied from the 
previous-frame memory 4. Then, for this data S3, 2- 
dimensional discrete cosine transformation is carried 
out for each block with the discrete cosine transforma- 
tion circuit. ^ 

The transformed data S5 from the discrete cosine 
transformation circuit 6 gets delayed at the delay cir- 
cuit 36 for the time needed for the second local coding 

6 



circuit block group 21 B and the quantization parame- 
ter control circuit 22 to perform signal processing for 
the transformation data S5, then the delayed data is 
supplied to the quantization circuit 8. 

While the delay circuit 36 is making transforma- 
tion data S5 delayed before quantization, the second 
local quantization circuit block group 21 B and the 
quantization parameter control circuit 22 determine 
the quantization step size for each unit block consti- 
tuting block group GOB to be transmitted, depending 
on whether that block corresponds to the background 
which is not degraded easily or corresponds to the 
boundary between the background and vanes of the 
water wheel which might be degraded easily. 

That is, in the second local decoding circuit 21 B, 
with the quantization/inverse-quantization circuit 23,' 
the transformation data S5 is quantized by quantiza- 
tion control signal S9 which determines the quantiza- 
tion step size for block group GOB, and, furthermore, 
inverse quantization is carried out for that quantized 
data to generate the representative value. Then, this 
representative value is transformed with the inverse 
discrete cosine transformation circuit 24. 

Furthermore, in the second local quantization cir- 
cuit block group 21 B, the local decoding circuit 25, 
utilizing the local decoded values of the previous 
frames, gets the local decoded value of the present 
frame with the.quantization accuracy determined for 
each block group GOB. then the obtained local de- 
coded value is supplied to the distortion calculation 
circuit 28 through the switching circuit 26. The distor- 
tion calculation circuit 28 calculates the difference be- 
tween the decoded data S22 of the present block 
group and the original video data S1 . And the obtained 
difference, distortion data S23, is applied to the quan- 
tization parameter control circuit 22. 

In the quantization parameter control circuit 22, 
the absolute value circuit 30 determines the absolute 
value of the distortion data S23, then the summation 
of the absolute values of the distortion for each block 
is calculated with the integral circuit 31. Thus, devia- 
tion of the decoded value of each block from the orig- 
inal video data, which would occur if the present quan- 
tization step size is utilized, is calculated. 

Meanwhile, in the quantization parameter control 
circuit 22, the standard distortion generation circuit 33 
predicts the magnitudes of distortion which might oc- 
cur for each block based on the quantization control 
data S9 which is such a control parameter to deter- 
mine the quantization size for each block group GOB 
that neither overflow nor underflow occurs for the 
data stored in the transmission buffer memory 11, and 
the predicted value is applied to subtraction circuit 32. 

Then, the subtraction circuit 32 in the quantiza- 
tion parameter control circuit 22 calculates the differ- 
ence between the magnitude of actual distortion and 
that of the standard distortion data S33. This calculat- 
ed difference data S34 is applied to the quantization 
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parameter determination circuit 34. 

The quantization parameter determination circuit 
34, judging from the fluctuation in the difference data 
S34, distinguishes whether or not the amount of infor- 
mation for each block increases locally with respect to 
the amount of information which is predicted based on 
the average quantization step size for each block 
group GOB. 

For example, when a block group GOB has a lot 
of blocks corresponding to the background pattern, 
there exists a small distortion, hence the quantization 
step size is set large by transmission buffer memory 
1 0. On the other hand, the block corresponding to the 
boundary between the water wheel and the back- 
ground has large distortion, therefore large magni- 
tude of distortion occurs with respect to the magnitude 
of distortion predicted based on the present quantiza- 
tion step size. 

* In such a case, the quantization parameter deter- 
mination circuit 34 reduces the quantization step size 
for corresponding blocks to decrease the distortion to 
the extent that neither overflow nor underflow occurs 
for the data in the transmission buffer memory 1 0, and 
supplies the quantization control signal S24 to the 
quantization circuit 8 and the inverse quantization cir- 
cuit 12 in order to set the control parameters ade- 
quately for each block so that no degradation in pic- 
ture quality occurs at the boundary between the water 
wheel and the background. 

After that, the quantization circuit 8 controls the 
quantization step size for each block which consti- 
tutes the block group GOB based on the quantization 
parameters which were previously calculated for each 
block group GOB and each block while the video data 
of block group GOB were delaying at the delay circuit 
36, then supplies it to variable length coding circuit 9. 
And then variable length coding is carried out and the 
data is transmitted on transmission line 11 through 
transmission buffer memory 10. 

At the same time, the inverse quantization circuit 
12 in the first local decoding circuit block group 21 A 
performs inverse quantization for the quantization 
data S6 utilizing the actual quantization step size de- 
termined by the quantization control signal S9 and 
S24. Thus the video data which was transmitted ac- 
tually is decoded in the transmitter and stored in the 
previous-frame memory 4. And then, the operations 
are repeated in the similar way. 

With the above constitution, local decoding of the 
video signal is carried out before the video signal is 
actually quantized and transmitted, and the locally de- 
coded value is compared with the original video data 
to determine the magnitude of distortion for each 
block. Based on this distortion magnitude, the quan- 
tization step size is controlled locally for each block so 
that averaging of the amount of information generated 
for entire block group GOB is more easily achieved 
and local degradation in picture quality is avoided 



even in the case that the amount of local information 
changes drastically in the same block group. 

In the above operation, the summation, for the 
same block group, of the magnitude of distortion gen- 

5 erated in each block can become almost same as the 
preliminary predicted magnitude of standard distor- 
tion so that irregular distribution of distortion in the 
block group can be effectively avoided. 

In the embodiment described above, the quanti- 

10 zation parameter control circuit 22 utilizes the abso- 
lute value of the difference data S23 between the lo- 
cally decoded video data S22 and the corresponding 
original input video data S1. However, this invention 
is not limited to that, but the sum of squares of the dif- 

15 ference data S23 can be utilized. Or nonlinear ly 
weighted values, etc., can be also utilized. 

Furthermore, in the above embodiment, the 
quantization parameter control circuit 22 predicts the 
sum of the absolute values of the magnitude of stan- 

20 dard distortion for each block based on the quantiza- 
tion control signal S9 which is the quantization control 
parameter for each block group GOB, however this in- 
vention is not limited to that but the prediction of the 
sum of squares of the magnitudes of standard distor- 
ts tion, etc., can be successfully applicable. 

Furthermore, in the above embodiment, the 
quantization parameter control circuit 22 has the con- 
stitution as shown in Fig. 6, however this invention is 
not limited to that but various kinds of circuits are ap- 

30 plicable which control the quantization parameter for 
each block based on the quantization control signals 
comprising difference data S22, which is the differ- 
ence between the input video signal of the original in- 
put video data S1 and the local decoded video data 

35 S22. 

In the above embodiment, the picture of a water 
wheel with the sky in the background is taken as an 
examples of video signal to be transmitted, however 
this invention is not limited to that but this invention is 

40 suitable for transmittitting any other pictures whose 
amounts of data change drastically.. 

In the embodiment described above, the quanti- 
zation parameters are controlled for each block based 
on the difference data S22, which is the difference be- 

45 tween the original input video data S1 and the local 
decoded video data S22, and based on the quantiza- 
tion control signal S9 which comprises the control 
parameter for eachi>lock group GOB, however this in- 
vention is not limited to that but the object can be ach- 

so ieved by controlling characteristics of filters, etc. 

Furthermore, in the embodiment described 
above, the quantization parameters are controlled for 
each block based on the difference data S22, which 
is the difference between the original input video data 

55 S3 and the local decoded video data S22, and based 
on the quantization control signal S9 which comprises 
the control parameter for each block group GOB, how- 
ever this invention is not limited to that but this inven- 
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tion is applicable for the wide varieties of the systems 
which utilize various kinds of signal processing for the 
video data to be transmitted. 

Furthermore in the above embodiment, as shown 
in Figs. 5 and 6, the picture data transmission system 5 
20 and the quantization parameter control circuit 22 
weights the picture data, however this invention is not 
limited to that but this invention is applicable for a pic- 
ture transmission system 40 and a quantization para- 
meter control circuit 41 as shown Figs. 7 and 8 in 10 
which like parts are designated by like reference nu- 
merals or characters in conjunction with Figs. 5 and 
6. 

The quantization parameter control circuit 41 is 
input the distortion data S23 from the distortion cal- 15 
culation circuit 28 and the brightness signal S41 of the 
original signal from the delay circuit 29. 

The quantization parameter control circuit 41 has 
a weighting circuit 42 which is constituted by ROM, 
etc. and weights the distortion data with the bright- 20 
ness signal 41 to output absolute weighted distortion 
data as the weighted difference data S42 to the inte- 
gration circuit 31. 

Here, the weighting circuit 42 weights nonlinearly 
the distortion data S24 to fit for eyesight characteristic 25 
of humans.. 

In this embodiment, a standard distortion gener- 
ation circuit 33 predicts standard or average absolute 
summation of distortion which would occur in each 
block in typical brightness signal level, based on the ao 
control parameter with each block group GOB which 
is input as the quantization control signal S9from the 
transmission buffer memory 1 0, so as to output as the 
standard distortion data S33. 

When the distortion summation data S32 is larger 35 
than the standard distortion data S33, the quantiza- 
tion parameter determination circuit 34 outputs the 
control data so that quantization accuracy is im- 
proved. On the contrary, when the distortion summa- 
tion data S32 is smaller than the standard distortion 40 
data S33, the quantization parameter determination 
circuit 34 outputs the control data so that quantization 
accuracy is degraded. 

Therefore the picture transmission system 40 re- 
alizes uniformity of the distortion with eyesight char- 45 
acteristic of humans, whereby information volume 
can be used more effectively and high quality picture 
transmission can be realized. 

Moreover in the embodiment above described, 
the weighting circuit 42 weights non-linearly the dis- so 
tortion data S23, however this invention is not limited 
to that but may weight linearly. 

Moreover, in the embodiment above described, 
the brightness signal is input with all bits thereof, how- 
ever this invention is not limited to this but may be in- 55 
put 3 through 5 bits of most significant bit side of the 
brightness signal. 

In Fig. 9 in which like parts are designated by like 



reference numerals or characters in conjunction with 
Fig. 5, the quantization parameter control circuit has 
same construction as Fig. 5, excepting that the quan- 
tization parameter of each black of transmission pic- 
ture is controlled based on the output result output 
from a flatness discrimination circuit block 72. 

The flatness discrimination circuit block group 72 
is constituted so that it determines the flatness of 
transmission data and supplies the result to quantiza- 
tion parameter control circuit 73. In this circuit block 
group, the original input video data S1 received from 
the preprocessing circuit 2 are successively applied 
to intra-field flatness prediction circuit 51. 

The intra-field flatness prediction circuit 51 is 
constituted so that it determines the 3-dimensional 
data, (Xi, yi,.zt) v (x 2 , y 2 . zj and (x 3 , y 3 , z 3 ) correspond- 
ing to three picture elements, P1, P2 and P3 respec- 
tively which exist in the same field (see Fig. 10). 

The intra-field flatness prediction circuit 51 is 
constituted so that it determines the 3-dimensional 
predicted data, (X40, y4o» Z40) » of predicted picture ele- 
ment P (denoted by small circle in Fig. 10) from the 3- 
dimensional data, (x lf y 1f z (x 2 , y 2 , z 2 ) and (x 3f y 3 , 
z 3 ), assuming that the fourth picture element P4 which 
is to be transmitted after the first through third picture 
element P1 through P3, is located on the same plane 
on which these three picture elements, P1 through P3 
are located. This predicted data is applied as predict- 
ed picture element data S51 to prediction error dis- 
crimination circuit 52. 

In the above operation, predicted data, (X40, V40. 
Z40), of predicted picture element P is described by the 
following equation. 

(X40.y40.z40) = (x 2 ,y 2 ,Z2) 
+ (x 3 , y 3l z 3 ) - (x 1f y 1f Zi) (1) 
That is, the first through third picture elements, P1 
through P3, and the predicted picture element, P, con- 
stitute a parallelogram. Components of 3-dimensional 
data (x, y, z) show horizontal and vertical positions in 
the field and picture element value at that point re- 
spectively. 

Getting the picture element value, Z4, of the fourth 
picture element, P4, corresponding to predicted pic- 
ture element P from input video data S1 , prediction er- 
ror discrimination circuit 32 determines the differ- 
ence, d (= Z40 - Z4), between picture element value Z4 
of the fourth picture element P4 and picture element 
value Z40 of predicted picture element P. This predict- 
ed error d, i.e., the error between predicted value Z40 
and the original picture element value, Z4, is applied 
as predicted error data S52 to the flatness discrimin- 
ation circuit 53. 

The flatness discrimination circuit 53 is constitut- 
ed by ROM (read only memory) and it determines the 
absolute value of predicted error data S52 received 
from prediction error discrimination circuit 52 and 
judging from this absolute value, it discriminates the 
flatness of picture to be transmitted and classifies the 
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flatness into 4 levels, "flat", "almost flat", "slightly flat" 
and "not flatness, which are assigned to 2-bit discrim- 
ination data S53, "11" through "00" respectively. This 
discrimination data S53 is applied to a flat area mem- 
ory 54. 

The flat area memory 54, having two bank mem- 
ories which can store the data corresponding to 8 
lines of the picture to be transmitted, stores succes- 
sively discrimination data S53 which indicates the 
flatness at each picture element of the original input 
video data S1, and supplies stored data S54 to the 
quantization parameter control circuit 73 with ade- 
quate timing. 

Delay circuit 55 is constituted so that it can send 
the original input video data S1 to the difference data 
generation circuit 3 with the adequate delay time in or- 
der to enable the quantization parameter control cir- 
cuit 73 to process the picture element data corre- 
sponding to stored data S54. 

The quantization parameter control circuit 73 is 
constituted so that it sends the quantization control 
signal S24 for each block to the quantization circuit 8, 
based on the distortion data S23 received from the 
distortion calculation circuit 28, the stored data S54 
received from the flat area memory 54, and the con- 
trol data S9 for each block group GOB received from 
the transmission buffer memory 10. 

In the quantization parameter control circuit 73, 
as shown in Fig. 11, the distortion data S23 and the 
stored data S34 are applied to a weighting circuit 61, 
so as to weight distortion data S23 by the stored data 
S 54 for each picture element. Weighted distortion 
data S61 is applied to a maximum circuit 62 and an 
average circuit 63. 

In this way, even in the case that distortion with 
respect the original picture occurs uniformly, the 
weighting circuit can perform heavier weighting for 
the data corresponding to the flat area of the picture 
to be transmitted where the distortion can be easily 
perceived. 

The maximum circuit 62 and the average circuit 

63 determine the maximum and average value of the 
weighted distortion data S61 respectively, and supply 
these values to a quantization parameter setting cir- 
cuit 64. 

The quantization parameter setting circuit 64, 
based on the maximum data S62 from the maximum 
circuit 42, the average data S63 from the average cir- 
cuit 63, and the quantization control signal S9 from 
transmission buffer memory 1 0, sets the control para- 
meter for each block which determines the quantiza- 
tion step size for each block, and sends out the set 
data as control data S24. 

Thus, the quantization parameter setting circuit 

64 reduces the quantization step size, when the 
amount of information of the video data correspond- 
ing to the block group GOB processed with second lo- 
cal coding circuit block group 21 B increases or when 
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the amount of information is being kept constant but 
the data corresponds to the area, such as flat area, 
whose distortion can be easily perceived, so that the 
picture quality of the video data to be transmitted on 

5 the transmission line 11 can be kept fairly constant. 

Inverse quantization circuit in the first local de- 
coding circuit block group 21A performs inverse 
quantization for quantization data S6 based on quan- 
tization control data S9 which is the quantization para- 

10 meter for each block group GOB and based on quan- 
tization control data S24 which is the quantization 
parameter for each block. 

Incidentally, in the video data transmission sys- 
tem 20, the transformation data S5 from the discrete 

15 cosine transformation circuit 6 is applied to quantiza- 
tion circuit 8 with the adequate delay time at delay cir- 
cuit 45 comprising FIFO memory. 

In the above operation, the delay circuit 45 gets 
the coefficient data S5 delayed for the time needed 

20 for second local decoding circuit block group 21 B to 
finish local decoding of at least one block and the time 
for the quantization parameter setting circuit 64 to de- 
termine the quantization parameter for each block. 
Then the delayed data is applied to the quantization 

25 circuit 8. Thus, the quantization circuit 8 is enabled to 
perform quantization for a required block, using con- 
trol data S24. 

Furthermore, in video data generation circuit 20, 
the previous-frame data generation circuit 14 re- 

30 ceives previous-frame data S2 from previous-frame 
memory 4 through delay circuit 46. 

In the above operation, delay circuit 46 gets the 
previous-frame data delayed for the time needed for 
second local decoding circuit block group 21 B quan- 

35 tization parameter control circuit 23 to perform their 
processing. Then the delayed data is sent out. Thus, 
the data of the previous-frame which has been al- 
ready sent out on transmission line 11 can be decod- 
ed. 

40 In the above constitution of the video data trans- 

mission system 20, the preprocessing circuit 2 suc- 
cessively converts input video signal VD into 8-bit in- 
put video data S1 , and supplies the converted data to 
the delay circuit 55 and the flatness discrimination cir- 

45 cuit block group 22. 

The difference-data generation circuit 3 determi- 
nes the inter-frame difference data, S3, i.e., the dif- 
ference between the data of the present frame re- 
ceived from the delay circuit 55 and the data of cor- 

50 responding block group GOB of the previous frame 
supplied from the previous-frame memory 4. Then, 
for this difference data S3, 2-dimensional discrete co- 
sine transformation is carried out for each block with 
the discrete cosine transformation circuit 6. 

55 < The delay circuit 45 gets the transformation data 
S5 delayed for the time needed for the second local 
coding circuit block group 21 B and the quantization 
parameter control circuit 23 to perform processing for 

9 
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the transformation data S5, then the delayed data is 
supplied to the quantization circuit 8. 

While the delay circuit 45 is getting the transfor- 
mation data S5 for block group delayed before quan- 
tization, the second local quantization circuit block 5 
group 21 B and the quantization parameter control cir- 
cuit 73 determine the quantization step size for each 
unit block constituting block group GOB to be just 
transmitted, depending on whether or not that block is 
such a block where distortion easily occurs. 10 

That is, in the second local decoding circuit 21 B, 
the quantization/in verse-quantization circuit 23 quan- 
tizes the transformation data S5 using the quantiza- 
tion control signal S9 and, furthermore, perform in- 
verse quantization for that quantized data to generate 15 
the representative value. Then, the inverse discrete 
cosine transformation circuit 23 performs inverse 
transformation for that representative value. 

Furthermore, the local decoding circuit 25 gets 
the local decoded value of the present frame, utilizing 20 
the decoded value of the previous frame for each 
block group GOB. Then the obtained local decoded 
value is supplied to the distortion calculation circuit 28 
through the switching circuit 26. The distortion calcu- 
lation circuit 28 calculates the difference between the 25 
decoded data S22 and the original input video data S1 
to be transmitted. And the obtained difference, distor- 
tion data S23, is applied to the quantization parameter 
control circuit 73. 

While the second local coding circuit block group 30 
21 B is performing the above processing, the flatness 
discrimination circuit block group 72 decides whether 
or not the picture to be transmitted, which is under the 
processing with second local coding circuit block 
group 21 B, is flat pattern whose distortion is easily 35 
perceived. 

In the flatness discrimination circuit block group 
72, receiving the original input video data S1 , the in- 
tra-f ield flatness prediction circuit 51 takes location of 
the remaining vertex of the parallelogram defined by 40 
three picture elements, P1, P2 and P 3 located in the 
same field as the location of the predicted picture ele- 
ment P. Thus, 3-dimensional predicted picture ele- 
ment data (X40, V40, Z40) is determined and is applied 
as the predicted picture element data S51 to the pre- 45 
dieted error discrimination circuit 52. 

The predicted error discrimination circuit 52 de- 
termines the predicted error d, which is the difference 
between picture element value Z40 of the predicted 
picture element data and the picture element value of 50 
the fourth picture element P4 in the video data to be 
actually transmitted. Then the flatness is discriminat- 
ed for each picture element based on predicted error 
d and represented with the 2-bit code to be succes- 
sively stored in the flat area memory 54. These stored 55 
data are applied to quantization parameter control cir- 
cuit 73. 

In the quantization parameter control circuit 73, 



weighting circuit 61 weights the distortion data S23 by 
stored data S54 for each picture element, in other 
words, it weights them depending on the degree of the 
ease to perceive the distortion, defined as the differ- 
ence between the decoded value of each block and 
the original video signal value, which actually occurs 
under the condition of the current quantization step 
size. 

Even in the case that the amount of information 
locally increases and large distortion occurs under 
the condition of the quantization step size given for 
the entire block group, light weighting is carried out for 
the picture elements whose distortion is not easily 
perceived. 

In contrast, even in the case that not so large dis- 
tortion occurs, heavy weighting is carried out for the 
picture elements in the flat area whose distortion can 
be easily perceived. 

After that, the quantization parameter setting cir- 
cuit 64 defines the quantization step size for each 
block, based on the maximum and average data (S62, 
S63) of weighted distortion which are determined for 
each block. Thus control data S24 is determined and 
sent out. 

For example, in the case that the amount of infor- 
mation locally increases and the nearly same magni- 
tude of distortion occurs for each block of the picture 
to be transmitted, the smaller quantization step size 
is set for thejlat area whose distortion can be easily 
perceived and the current step size is kept for the pat- 
tern whose distortion can not be easily perceived. 

In this way, the more amount of information is al- 
located just for the pattern whose distortion can be 
easily perceived, therefore more effective utilization 
of information can be achieved. 

Finally, based on the quantization parameter 
which was determined preliminary before the present 
video data of the block group is actually transmitted, 
the quantization circuit 8 changes the quantization 
step size to give the optimum step size for each block 
composing block group, and sends the data to the va- 
riable length coding circuit 9. The data are sent out 
through the transmission buffer memory 10 to the 
transmission line 11. 

At the same time, the inverse quantization circuit 
12 in the first local decoding circuit block group 21 A 
performs inverse quantization for the quantization 
data S6 utilizing the actual quantization step size de- 
termined by the control data S24. Thus the video data 
which was transmitted actually is reproduced in the 
transmitter and stored in the previous-frame memory 
4. 

With the above constitution, local decoding of the 
video signal is carried out before the video signal is 
actually quantized and transmitted, and the locally de- 
coded value is compared with the original input video 
data to determine the magnitude of distortion. Fur- 
thermore, the magnitude of the distortion is weighted 
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depending on the degree of ease to perceive the dis- 
tortion. Based on this weighted distortion magnitude, 
the quantization step size is controlled locally to get 
better picture quality even in the case that the amount 
of information changes locally and drastically. s 

In the above embodiment, the plane expectation 
for each picture element in a field is carried out based 
on the equation (1), however the this invention is not 
limited to that, but another condition may be utilized 
for the plane expectation. 10 

Furthermore, in the above embodiment, expect- 
ed picture element P is obtained by one plane expec- 
tation, however this invention is not limited to that but 
the plural times of plane expectation can lead to the 
better prediction accuracy of predicted picture ele- 15 
ment P. 

Furthermore, in the above embodiment, the pic- 
ture is considered to be plane when predicted picture 
element P coincides with original picture element P4, 
however this invention is not limited to that but the pic- 20 
ture may successfully be considered to be plane when 
original picture element P4 is located in the adequate- 
ly given region near the predicted picture element P. 

In the above embodiment, the flatness discrimin- 
ation circuit 53 utilizes the absolute value of the pre- 25 
dieted error d as a value to show the degree of flat- 
ness, however this invention is not limited to that but 
it can utilize the square of the predicted error d, non- 
linear function of the predicted error d, and so on. 

In the embodiment described above, the flatness 30 
discrimination circuit 53 is composed by read only 
memory, however this invention is not limited to that 
but the flatness for each picture element can be ob- 
tained by another calculating process. 

Furthermore, in the above embodiment, the flat- 35 
ness of video data is described by 2-bit data, however 
this invention is not limited to that but it can be descri- 
bed by 1-bit or plural bit data. 

Furthermore, in the above embodiment, flat area 
memory 54 is composed by 2 sets of memory which 40 
can store the data for 8 lines, however this invention 
is not limited to that but it can be composed to that 
they can store the data for 16 lines, one field, and so 
on. 

Furthermore, in the above embodiment weight- 45 
ing circuit 61 is composed by read only memory, how- 
ever this invention is not limited to that but it can be 
composed by a multiplier, etc. 

Furthermore, in the above embodiment weight- 
ing circuit 61 weights linearly distortion data S23 by 50 
stored data S54, however this invention is not limited 
to that but it can weight non-linear ly the data. 

Furthermore, in the above embodiment, the 
quantization parameter setting circuit 64 sets quanti- 
zation parameter for each block based on the maxi- 55 
mum data S62 and the average data S43, however 
this invention is not limited to that but it can set quan- 
tization parameter based on either of them or based 



on the standard deviation of the data. 

Furthermore, in the above embodiment, quanti- 
zation parameter control signal S9 is fed back from 
the transmission buffer memory 10 to the quantiza- 
tion parameter control circuit 23, however this inven- 
tion is not limited to that but quantization parameter 
can be set for each block only based on distortion 
data S23 and stored data S54 with no feedback of 
quantization control signal S9. 

While there has been described in connection 
with the preferred embodiments of the invention, it will 
be obvious to those skilled in the art that various 
changes and modifications may be made therein 
without departing from the invention, and it is aimed, 
therefore, to cover in the appended claims all such 
changes and modifications as fall within the scope of 
the invention. 



Claims 

1. A video signal transmission apparatus for ortho- 
gonally transforming a video signal of unit block 
groups (GOB), each having a plurality of unit 
blocks (MB), into coefficient data (S5) and then 
quantizing said coefficient data into quantization 
data (S6), comprising: 

a local decoding means (21 B) for quantiz- 
ing and J n verse-quantizing said coefficient data 
based on first quantization information (S9) de- 
termined for each of said unit block groups, and 
performing inverse-orthogonal trans formation to 
generate local decoded data (S22); 

a difference data detecting means (28) for 
detecting the difference (S23) between said local 
decoded data decoded by said local decoding 
means and the original video signal (S1) corre- 
sponding to said local decoded data; 

a controlling means (22) for determining 
second quantization information (S24) for each of 
said unit blocks based on the difference detected 
by said difference data detecting means; and 

a quantizing means (8) for determining a 
quantized size of said video signal based on said 
first quantization information and said second 
quantization information. 

2. A video signal transmission apparatus according 
to claim 1, wherein said control means includes: 

a distortion calculating means (30, 31) for 
calculating a distortion value (S32) for each said 
unit block based on the difference detected by 
said difference detecting means; 

a standard distortion calculating means 
< (33) for calculating a standard distortion value 
(S33) for each said unit block based on said first 
quantization information; 

a distortion value comparing means (32) 
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for comparing said distortion value and said stan- 
dard distortion value output from said distortion 
calculating means and said standard distortion 
calculating means respectively; and 

a quantization information control means 5 
(34) for controlling said second quantization infor- 
mation for each unit block based on the compar- 
ison result of said distortion value comparing 
means. 

10 

3. A video signal transmission apparatus according 
to claim 1, wherein said control means includes: 

a distortion calculating means (42, 31) for 
calculating a distortion value (S32) based on the 
difference detected by said difference data de- 15 
tecting means and the level of the original video 
signal (S41) corresponding to said local decoded 
data; 

a standard distortion calculating means 
(33) for calculating a standard distortion value 20 
(S33) for each said unit block based on said first 
quantization information; 

a distortion value comparing means (32) 
for comparing said distortion value and said stan- 
dard distortion value output from said distortion 25 
calculating means and said standard distortion 
calculating means; and 

a quantization information controlling 
means (34) for controlling said second quantiza- 
tion information for each said block based on the 30 
comparison result of said distortion value com- 
paring means. : 

4. A video signal transmission apparatus for ortho- 
gonally transforming a video signal of unit block 35 
groups (GOB), each having a plurality of unit 
blocks (MB), into coefficient data (S5) and then 
quantizing said coefficient data into quantization 
data (S6), comprising: 

a local decoding means (21 B) for quantiz- 40 
ing and inverse-quantizing said coefficient data 
based on first quantization information (S9) de- 
termined for each of said unit block groups, and 
performing inverse-orthogonal transformation to 
generate local decoded data (S22); 45 

a difference data detecting means (28) for 
detecting the difference (S23) between said local 
decoded data decoded by said local decoding 
means and the original video signal (S1) corre- 
sponding to said local decoded data; so 

a flatness detecting means (S1, S2, S3) 
for detecting flatness of each picture element 
constituting said unit blocks; 
a controlling means for determining second quan- 
tization information (S24) for each said unit block 55 
corresponding to a distortion calculation value 
determined based on said flatness (S54) and 
said difference; and 



a quantizing means (8) for determining a 
quantized size of said vide signal based on said 
first quantization information and said second 
quantization information. 

5. A video signal transmission apparatus according 
to claim 4, wherein said flatness detecting means 
includes: 

a flat area predicting means (S1) for pre- 
dicting a predicted picture element value (P04) of 
each picture element which constitute said unit 
blocks; 

a difference detecting means (S2) for de- 
tecting the difference between said predicted pic- 
ture element value predicted by said flat area pre- 
dicting means and the original picture element 
value of the original video signal corresponding to 
said predicted picture element value; and 

a flatness discriminating means (S3) for 
discriminating the flatness of said picture ele- 
ments based on the detection result of said differ- 
ence detection means. 

6. A video signal transmission apparatus according 
to claim 4, wherein said controlling means in- 
cludes: 

a distortion calculating means (61) for 
weighting the difference data output from said dif- 
ference .data detecting means and calculating a 
calculated distortion value (S63) for each said 
unit block; and 

a quantization information controlling 
means (64) for determining said second quanti- 
zation information for each said unit block based 
on said calculated distortion value calculated by 
said distortion calculating means. 

7. A video signal transmission apparatus according 
to any one of claims 1 to 6, comprising: 

a means (9) for variable length code cod- 
ing the data quantized by said quantizing means; 
and 

a memory means (10) for controlling a 
transmission rate of transmission data output 
from said variable length code coding means to a 
transmission line; 

wherein said first quantization information 
is generated based on the amount of the residual 
data remaining in said memory means. 

8. A video signal transmission method for orthogon- 
ally transforming a video signal of unit block 
groups (GOB), each having a plurality of unit 
blocks (MB), into coefficient data (S5) and then 

1 quantizing said coefficient data into quantization 
data (S6), comprising the steps of: 

quantizing and inverse-quantizing said 
coefficient data based on first quantization infor- 



SDOCID:<EP 0526201A2 I > 



23 



EP 0 526 201 A2 



24 



mation (S9) determined for each said unit block 
group, and performing inverse-orthogonal trans- 
formation to generate local decoded data (S22); 

detecting the difference (S23) between 
said local decoded data and the original video sig- 
nal (S1) corresponding to said local decoded 
data; 

determining second quantization informa- 
tion (S24) for each said unit block based on said 
difference; and 

determining a quantized size of said video 
signal based on said first quantization informa- 
tion and said second quantization information. 



tion (S24) for each said unit block corresponding 
to a distortion calculation value (S63) to be deter- 
mined based on said flatness and said differ- 
ence; and 

5 quantizing said video signal based on said 

first quantization information and said second 
quantization information. 

12. A video signal transmission method according to 
10 claim 11, wherein said step of detecting flatness 

comprises the steps of: 

predicting predicted picture element value 
(PCM) for each picture element constituting said 
unit blocks; 

is determining the difference (S52) between 

said predicted picture element value and original 
picture element value of the original video signal 
corresponding to said predicted picture element; 
and 

20 discriminating flatness of said picture ele- 

ment based on said difference between said pre- 
dicted picture element value and original picture 
element value. 

25 13. A video signal transmission method according to 



9. A video signal transmission method according to 
claim 8, wherein said step of determining said 
second quantization information includes the 
steps of: 

calculating a distortion value (S32) based 
on said difference data; 

calculating a standard distortion value 
(S33) for each said unit block based on said first 
quantization information; and 

comparing said distortion value and said 
standard distortion calculation value. 

10. A video signal transmission method according to 
claim 8, wherein said step of determining said 
second quantization information includes the 
steps of: 30 

calculating a distortion value for each said 
unit block based on said difference and a level 
(S41) of the original video signal corresponding 
to said local decoded data; 

calculating a standard distortion value for 35 
each of said unit blocks based on said first quan- 
tization information; and 

comparing said distortion value and said 
standard distortion value. 

40 

11. A video signal transmission method for orthogon- 
ally transforming a video signal of unit block 
groups (GOB), each having a plurality of unit 
blocks (MB), into coefficient data (S5) and then 
quantizing said coefficient data into quantization 45 
data (S6) t comprising the steps of: 

quantizing and inverse-quantizing said 
coefficient data based on first quantization infor- 
mation (S9) determined for each said unit block 
group, and performing inverse-orthogonal trans- so 
formation to generate local decoded data (S22); 

detecting the difference (S23) between 
said local decoded data and the original video sig- 
nal (S1) corresponding to said local decoded 
data; 55 

detecting flatness (S52) for each picture 
element constituting said unit blocks; 

determining second quantization informa- 



claim 11, wherein said step of determining said 
second quantization information comprises the 
steps of: 

generating weighted distortion data (S61) 
from said flatness and said difference (S23); 

determining a distortion calculation value 
(S63) for each said unit block based on said 
weighted distortion data; and 

determining second quantization informa- 
tion for said each unit block based on said distor- 
tion calculation value. 

14. A video signal transmission method according to 
any one of claims 8 to 13, wherein said video sig- 
nal transmission method comprises the steps of: 

generating transmission data (S8) by vari- 
able length code coding the data quantized based 
on said first and second quantization information; 

temporarily storing said transmission data 
into memory means (10); and 

determining said first quantization infor- 
mation based on a residual data amount of said 
memory means. 



lSDOCID:<EP 0526201A2 I > 



EP 0 526 201 A2 




LV4 
LV 3 

LV 2 
LV, 
LV 0 



STPS 




, 4- 1 

I ' 
I I 




► — 


1 
1 
1 

---- 


n 
I 




i 


• 






I 




1 


. ■ i ! i 



LV 0 LV, LV 2 LV 3 LV 4 



QUANTIZATION 
LEVEL 



FIG. 4 



14 



EP 0 526 201 A2 




15 



ISDOCID: <EP 05262O1A2 I > 



EP 0 526 201 A2 



CD 00 CD 



CD 
CD 



{[ 



mi 



m 



CD 

8 



cvi< 



ro / 

/ 

I 

/ 



T 

CD 
O 
CD 



CD 



or 
u_| 



H 



16 



SDOCtD: <EP 0526201 A2 I > 



EP 0 526 201 A2 




0526201A2 I > 



EP 0 526 201 A2 



US24 



S9 



t .^30 



A VAL 



3,1 ^S31 



S34 




33 



22 



FIG. 6 



18 



ISDOCID: <EP 0526201A2 I > 



EP 0 526 201 A2 




BP 0 526 201 A2 




20 



JSDOCID:<EP 0526201 A2 I > 



EP 0 526 201 A2 




SDOCID: <EP 0526201 A2 I > 



EP 0 526 201 A2 




HORIZONTAL VALUE 



VERTICAL VALUE 



FIG. 10 




FIG. 11 

22 



ISDOCID:<EP 0526201 A2 I > 




Europaisches Patentamt ^ 
European Patent Office 
Office europeen des brevets 




(u) Publication number: 0 526 201 A3 
EUROPEAN PATENT APPLICATION 



(g) Application number : 92306954.6 
(3) Date of filing : 30.07.92 



<§) int. cl s : H04N7/13, H04N 7/137, 
H04N 7/133 



(So) Priority : 31.07.91 JP 214659/91 
W 31.07.91 JP 214662*1 
16.10.91 JP 298473/91 

(43) Date of publication of application : 
03.02.93 Bulletin 93/05 

(S) Designated Contracting States : 
w DE FR GB 

(S3) Date of deferred publication of search report 
19.05.93 Bulletin 93/20 



(71) Applicant : SONY CORPORATION 
6-7-35 Kitashinagawa Shinagawa-ku 
Tokyo 141 (JP) 

(72) Inventor : Kojima, Yuichl 

c/o Sony Corporation, 6-7-35 Kitashinagawa 
Shinagawa-ku, Tokyo 141 (JP) 

<g) Representative : Robinson, Nigel Alexander 
Julian et al 

D. Young & Co., 10 Staple Inn 
London WC1V 7RD (GB) 



(g) Video signal transmission system and method. 



C57 



CO 

< 



CM 

<£> 
CM 

m 



In a video signal transmission system in 
which input video signals are coded for trans- 
mission, the coded data are decoded with quan- 
tization information (S9) determined for each 
block group (GOB) from the amount of the data 
remaining in the buffer memory (10). The de- 
coded data (S22) are compared with the onginai 
video data (S1) to determine the difference 
(S23). The differences are weighted with flat- 
ness which relates to the degree of perceivabi- 
lity of possible distortion. The quantization size 
for the video data to be transmitted (S8) is 
determined based on the difference or the 
weighted difference so that the quality of the 
picture to be transmitted can be improved. 




in 

M 



0L 
LU 



Jouve, 18, rue Saint-Denis. 75001 PARIS 



>ISDOCID: <EP 0526201 A3 I > 



EP 0 526 201 A3 



I 
I 




European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 92 30 6954 



Category 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Citation of document with indication, where appropriate, 
of relevant passages 



EP-A-0 424 060 (SONY CORPORATION) 

* page 2, line 29 - page 4, line 43; 
figure 4 * 

* page 10, line 3 - line 11; figure 6 * 

US-A-4 077 053 (ISHIGUR0) 

* column 2, line 33 - column 3, line 44; 
figure 1 * 



Relevant 
to claim 



1.8 

2-7,9-14 
1,8 



CLASSIFICATION OF THE 
APPLICATION ant. CLS ) 



H04N7/13 

H04N7/137 

H04N7/133 



TECHNICAL FIELDS 
SEARCHED (Jot. CLS) 



H04N 



The 



search report has been drawn up for all claims 



FtaaaffoKk 

BERLIN 



D*« «f tarn aJaU— ll« 

15 FEBRUARY 1993 



MATERNE A. 



CATEGORY OF CUED DOCUMENTS 

X : particularly relevant if taken alone 

Y : particular.? relevant if combined with another 

document of the same category 
A : technological background 
O : noo-written disclosure 
P : intermediate document 



T : theory or principle underlying the invention 
E : earlier patent document* hut pubUsbed on, or 

after to* filing is** 
D : document dted in tbo application 
L : document died for other reasons 



iTaem^*orth7r«e7itenl family, corresponding 



ISDOCIDkEP 0526201 A3 I > 



